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SYSTEMS A ND METHODS FOR AUTOMATED NAVIGATION BETWE EN 
DYNAMIC DAT A WTTH DISSIMILAR STRUCTURES 



Field of the Invention 

The present invention relates generally to automating data analysis tasks and, more 
5 particularly, to analysis tasks that require navigation between dynamic data that has 

dissimilar structures. 

Back ground of the Invention 

The present invention provides for systems and methods for automatically navigating 
between dynamic data that has dissimilar structures. The term "dynamic" as used herein 

10 refers to frequent change with respect to data, a characteristic that affects the efficiency of 
navigation techniques. The term "dissimilar structure" as used herein refers to a data 
structure containing information that is not present in another data structure. Thus, it is said 
that the first data structure is dissimilar with respect to the second data structure. A problem 
in the management of distributed systems is described below to illustrate the prior art 

15 background. However, it is to be appreciated that the invention has broader applications. 

Rapid improvements in both hardware and software have dramatically changed the 
cost structure of information systems. Today, hardware and software account for a small 
fraction of these costs, typically less than 20 percent (and declining). The remaining costs 
relate to the management of information systems, such as software distribution, providing 

20 help desk support, and managing quality of service (QoS). 

Decision support is critical to the management of information systems. For example, 
in software distribution, we need to know: (i) which machines require software upgrades; (ii) 
what are the constraints on scheduling upgrades; and (iii) the progress of upgrades once 
installation has begun. In QoS management, decision support detects QoS degradations, 

25 identifies resource bottlenecks, and plans hardware and software acquisitions to meet future 

QoS requirements. 
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Accomplishing these tasks requires a variety of information, such as, for example, 
QoS measurements, resource measurements (e.g., network utilizations), inventory 
information, and topology specifications. Collectively, we refer to these information sources 
as data. Much of this data is dynamic. Indeed, measurement data changes with each 
5 collection interval. Further, in large networks, topology and inventory information change 

frequently due to device failures and changes made by network administrators. 

We use the term "dataset" to describe a collection of data within the same structure. 
For example, a dataset might be organized as a relational table that is structured so that each 
row has the same columns. Here the data is structured into rows such that each row has a 

10 value for every column. A dataset contains multiple "data elements" (hereinafter, just 

elements), which are instances of data structured in the manner prescribed by the dataset 
(e.g., a row in a relational table). A group of elements within the dataset is called an 
"element collection." An element collection is specified by a "collection descriptor" (e.g., 
SQL where-clmse for a relational table or line numbers for a sequential file). A collection 

15 descriptor consists of zero or more "constraints" that describe an element collection. A 

constraint consists of an "attribute" (e.g., a column name in a relational table or a field in a 
variable-length record), a relational operator (e.g., =, <, >), and a value. 

Due to the diversity of software tools, administrative requirements, and other factors, 
data is typically grouped into multiple datasets. Thus, decision support often requires 

20 navigating from an element collection in one dataset to one or more element collections in 
other datasets. We refer to these as the "source element collection," "source dataset," "target 
element collections" and "target datasets," respectively. 

With this background, we state one of the problems addressed by the present 
invention. We are given a source element collection and multiple target datasets. The 

25 objective is to find the target element collection that "best matches" the source element 

collection. By best matches, it is meant that the structure and content of the source element 
collection is the most similar to that of the target element collection. 



Y0998-467 



2 



To illustrate the problem addressed, we describe a scenario in QoS management. 
Considered is a situation in which end-users experience poor quality of service as quantified 
by long response times. The objective is to characterize the cause of long response times by: 
(i) when they occur; (ii) who is affected; (iii) which configuration elements are involved; and 
5 (iv) what components of the configuration element account for most of the delays. 

The analyst starts with a dataset containing end-to-end response times. The dataset 
is structured into the following columns: shift, hour, subnet, host, user's division, user's 
department, user name, transaction issued, and response time. The analyst proceeds as 
follows: 

10 Step 1. The analyst isolates the performance problem. This may be done in any 

conventional manner, such as, for example, is described in R.R Berry and J.L. Hellerstein, 
"A Flexible and Scalable Approach to Navigating Measurement Data in Performance 
Management Applications," Second IEEE Conference on Systems Management, Toronto, 
Canada, June, 1996. In the example, isolation determines that poor response times are 

15 localized to the element collection described by the constraints: shift=l, hour=8, 

subnet=9.2.15, division-25, department=MVXD, user-ABC, and transaction^ XX. At this 
point, the analyst has characterized when the problem occurs, who is affected, and which 
configuration elements are involved. 

Step 2. To determine what components of the configuration element account for 

20 most of the delays, the analyst must examine one or more other datasets. After some 
deliberation and investigation by the analyst, the analyst selects a dataset of operating system 
(OS) measurements that are structured as follows: hour, minute, shift, subnet, division, 
department, efficiency, waiting time, CPU waits, I/O waits, page waits, and CPU execution 
times. 

25 Step 3. The analyst selects the subset of the OS data that best corresponds to the 

response time data. Doing so requires dealing with two issues: (i) the source and target 
datasets are structured somewhat differently in that the first has transaction information 
(which the second does not), and the second reports time in minutes (which the first does 
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not); and (ii) the second dataset does not have records for user ABC, the user for which a 
problem was isolated. To resolve the first problem, the analyst decides to use only the 
information common to both datasets. So, transaction information and minutes are ignored 
when navigating from the response time data to the OS data. The second problem is resolved 
5 by assuming that users within the same department are doing similar kinds of work. Thus, 

the target element collection is described by the constraints: shift=l, hour=8, subnet=9.2.15, 
department^MVXD, and user=ABC. 

Step 4. The analyst uses the OS data to characterize the host component that 
contributes the most to response time problems. This characterization reveals that paging 

10 delays account for a large fraction of end-to-end response times. 

Steps 1 and 4 employ similar problem isolation logic. Indeed, automation exists for 
these steps. Unfortunately, in the prior art, steps 2 and 3 are performed manually. As such, 
these steps impede the automation, accuracy and comprehensiveness of problem isolation. 
This, in turn, significantly increases management costs. The challenges raised by steps 2 and 

1 5 3 above are modest if there are a small number of measurement sources. Unfortunately, the 
number of measurement sources is large and growing. 

Dissimilarities in the structure of datasets typically arise because measurements are 
specific to the measured entity. Hence, heterogeneous equipment means heterogeneous 
measurement sources. Heterogeneity includes the different types of devices (e.g., routers 

20 versus file servers), different vendors, and different versions of the same product from the 
same vendor. With rapid changes in information technology, acquisition cycles are now 
much longer than technology cycles. For example, depreciation times for personal 
computers are typically 3 to 5 years, but the technology changes every 9 to 12 months. 
Further, customers typically upgrade hardware and software in an incremental fashion. The 

25 combination of these factors means that customers have an increasingly diverse collection 

of hardware and software. As such, the diversity of measurement sources is rapidly 
increasing. 
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One proposed way to attempt to avoid the problem of heterogeneous measurement 
sources is to build a data warehouse that integrates data with dissimilar structure, as 
described in R. Kimbell, "The Data Warehouse Toolkit," John Wiley and Sons, 1996. This 
is accomplished by employing tools that translate data formats and semantics into a common 
structure. Such an approach works well for fairly static data that is analyzed frequently in 
that the cost of building and maintaining the data warehouse is amortized over a long time 
window and a large number of data accesses. However, in systems management 
applications, the data is dynamic, such as QoS measurements that change every minute. 
Also, the detailed data used for solving QoS problems is only needed when a problem arises. 
Thus, the cost of building and maintaining the data warehouse far outweighs the benefits 
provided. 

Existing art for navigating between datasets is specific to the manner in which the 
data is organized, that is, the conceptual model employed. We consider three such 
conceptual models: relational data (with variations), multidimensional databases (MDDB), 
and text documents. While other organizations may exist (e.g., graphical structures, such as 
hyper linked documents), similar issues arise in these organizations as well. 

Considered first is data organized as relational tables. Here, a dataset is a table, an 
element is a row in a table, and a collection descriptor is an SQL w/zere-clause. Navigation 
between datasets is accomplished through SQL queries that use the yew operation. A join 
requires specifying the table to navigate to (e.g., in the from clause of SQL queries) and the 
join attributes used in the where clause. However, often times situations exist in which 
neither the table to navigate to nor the choice of join attributes are known. Thus, while it 
may be useful to employ join operations in an attempt to achieve automated navigation, the 
join operation itself does not solve the existing problems. 

Considered next is data organized as MDDB, as described in R.F. Berry and J.L. 
Hellerstein, "A Flexible and Scalable Approach to Navigating Measurement Data in 
Performance Management Applications," Second IEEE Conference on Systems 
Management, Toronto, Canada, June, 1996. Conceptually, such an organization can be 
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viewed as a layer on top of the relational model. The MDDB structure attributes into 
dimensions. Within a dimension, attributes may be further structured into a directed acyclic 
graph (DAG). Here, a dataset is a cube (a MDDB schema along with its base data), an 
element is a cell within a cube, and a collection descriptor is a where clause that abides by 
5 the hierarchical structure imposed by the MDDB. In the example above, there might be 

dimensions for Time, Configuration Element, Workload and Metric. In the source dataset, 
the Workload dimension may contain the attributes division, department, user, and 
transaction ordered in this manner. Thus, the coordinate for this dimension would be 
division=25, department=MVXD, user-ABC, and transaction=_XX. 

10 Navigation within a multidimensional database is accomplished by drill-down and 

drill-up operations. Drill-down adds constraints in one or more dimensions such that the 
attribute of the constraint is at the next lower level in the dimension's DAG. Drill-up is the 
inverse operation. It removes constraints in one or more dimensions. The attributes of the 
constraints removed are at the next higher level in the dimension hierarchies. For example, 

15 consider the constraints for the Workload dimension: division=25, department=MVXD, 

user-ABC, and transaction=_XX. Drill-up yields the constraints division=25, 
department=MVXD, and user=ABC. 

Navigation between cubes can be accomplished in many ways. One approach is to 
use SQL queries, as described in R. Kimbell, "The Data Warehouse Toolkit," John Wiley 

20 and Sons, 1996. However, this suffers from the same drawbacks as described above. 

Another approach to automated navigation between cubes is to employ a drill- 
through operation. With drill-through, a source cell is associated with one or more target 
cells. This is either done by specifying an explicit association or by specifying a program 
that computes the association dynamically. The former is poorly suited to dynamic 

25 environments in which new cubes are added and others are deleted or their structure is 

modified. The latter provides a mechanism for dealing with these dynamics, but in and of 
itself, providing programmatic control does not solve the problems associated with 
determining which target data to navigate to. 
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A third way of organizing data is as text documents. Here, the navigation is from 
keywords (e.g., as specified in an Internet search engine) or whole documents to other 
documents. This is accomplished by preprocessing the documents to extract keywords (and 
keyword sequences) to provide an index. Such an approach works well for fairly static data 
5 since the index structures are computed infrequently. However, it works poorly for dynamic 

data. 

Further, it is known that data structured as comma-separated-values (or other 
separators) can readily be treated as relationally structured data. This is accomplished by: 
(a) describing each column in terms of the distribution of its element values, and (b) using 

10 a similarity metric to find comparable columns in other datasets. 

Still further, existing art on federated and multidatabase systems, as described in M.T. 
Ozsu and P. Valduriez, "Principles of Distributed Database Systems," Prentice Hall, 1991, 
as well as schema integration, as described in J. A, Larson, S.B. Navathe, R. Elmasri, "A 
Theory of Attribute Equivalence in Databases with Application to Schema Integration," 

15 IEEE Transactions on Software Engineering, vol. 15, no. 4, April 1989, teaches how to 
address problems with heterogeneous names and semantics of columns in relational 
databases. These approaches allow for performing SQL queries in which the tables 
referenced in the from clause may have different relational schema. However, these 
approaches do not teach how to automate the selection of relational tables to use in the from 

20 clause, nor do they address how to determine the target element collection that is closest to 

the source element collection. 

Summary of the Invention 

The present invention provides systems and methods that aid in decision support 
applications by automatically selecting data relevant to an analysis. This is accomplished 
25 by using the structure of the source dataset in combination with the content of the source 

element collection to identify the closest element collections within one or more target 
datasets. 
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Particularly, the invention is implemented in a form which includes certain functional 
components. These components, as will be explained, may be implemented as one or more 
software modules on one or more computer systems. A first component is referred to as an 
inter-dataset navigation engine (IDNE). The IDNE is invoked by analysis applications to 
5 automate the selection of related data. The IDNE makes use of another component referred 

to as dataset access services. The dataset access services component knows the accessible 
datasets and their structures, creates and manipulates collection descriptors, and provides 
access to elements within a dataset that are specified by a collection descriptor. 

In one embodiment, automated navigation according to the invention may be 

10 accomplished in the following manner. First, the IDNE iterates across all target datasets to 

do the following: (a) use the structure of the source and target datasets to transform the 
source collection descriptor into a preliminary collection descriptor for the subset of the 
target dataset that is closest to the source element collection; (b) construct the final collection 
descriptor by transforming the preliminary collection descriptor until it specifies a non-null 

15 subset of the target dataset; and (c) compute a distance metric representing how close the 
source element collection (or collection descriptor) is to the target element collection (or 
collection descriptor). The IDNE then returns a list of triples including a name of the target 
dataset, a target collection descriptor, and a value of the distance metric for each target 
dataset. 

20 The list may be presented to an end-user who then selects the preferred target dataset. 

Alternatively, the list may be provided to a program that does additional processing. The list 
may be sorted by descending value of the distance metric so as to provide a ranking of the 
target datasets and their target element collections. 

It is to be appreciated that the systems and methodology of the present invention 

25 advantageously eliminate the drawbacks (e.g., accuracy, comprehensiveness, etc.) that exist 

in the manual navigation approach and other prior art approaches described above. To 
illustrate the operation of this methodology, we apply it in the context of the previously 
presented exemplary scenario. Recall that the collection descriptor of the elements in the 
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source dataset is: shift=l, hour=8, subnet=9.2.15, division=25, department=MVXD, 
user-ABC, and transaction=__XX. We also use the operating system (OS) data previously 
introduced- This data is structured into the following columns: shift, hour, minute, subnet, 
division, department, efficiency, waiting time, CPU waits, I/O waits, page waits, and CPU 
5 execution times. 

The invention performs steps (a) through (c) above as follows. A preliminary 
collection descriptor is constructed for the OS data by transforming the source collection 
descriptor (step (a)). In particular, the constraints such as transaction=_XX that have an 
attribute that is not present in the target dataset are addressed. One approach to resolving this 

10 is to remove such constraints. Doing so yields: shift=l, houi=8, subnet=9.2.15, division=25, 

department-MVXD, and user-ABC. 

Next, the final collection descriptor in the target dataset is constructed (step (b)). 
This can be achieved by doing the following. First, the element collection specified by the 
preliminary collection descriptor is retrieved. If this collection is empty, one or more 

15 constraints from the collection descriptor are removed. This is repeated until a non-null 

element collection is obtained. In the exemplary scenario, there is no data for user ABC. So, 
the constraint user=ABC is removed. Thus, the final target collection descriptor is shift=l, 
hour=8, subnet=9.2.15, division=25, and department==MVXD. 

Lastly, the metric for the distance between the source and target element collections 

20 is computed (step (c)). Note that in the above construction, the target collection descriptor 

always has a subset of the constraints in the source collection descriptor. Thus, a convenient 
distance metric is the difference between the number of constraints in the source and target 
collection descriptors. In the exemplary scenario, this value is two. 

Accordingly, the present invention provides automation for selecting datasets relevant 

25 to analysis tasks. Such automation is crucial to improving the productivity of decision 

support in systems management applications. The automation enabled by the invention 
provides value in many ways. For example, the invention makes the novice analyst more 
expert by providing a list of target datasets and collection descriptors that are closest to an 
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element collection at hand (i.e., the source element collection). As a result, the novice 
focuses on the datasets that are most likely to be of interest in the analysis task. By way of 
further example, the invention makes expert analysis more productive. This is achieved by 
providing the target collection descriptor for each target dataset thereby enabling the 
5 construction of a system in which analysts need only click on a target dataset (or collection 

descriptor) in order to navigate to its associated element collection. 

The techniques employed today for dataset selection (e.g., drill-through in MDDBs) 
embed fixed associations between datasets or require special purpose programs that must be 
maintained if datasets and/or attributes are added or deleted. In contrast, the invention uses 

10 the structure of the data itself to select relevant data. Such an approach adapts automatically 

to changes in the structure and content of the data being analyzed. 

In another embodiment of the invention, the set of attributes considered when 
transforming the source collection descriptor into the target collection descriptor may be 
constrained. Indeed, the exemplary scenario does not consider the attributes response time, 

15 efficiency, waiting time, CPU waits, I/O waits, page waits, and CPU execution time. 

In yet another embodiment of the invention, different levels of importance may be 
assigned to attributes. For example, a match on the attribute subnet may be considered more 
important than a match on the attribute division. This may be implemented by changing the 
manner in which the distance metric is computed so that it includes weights assigned. In this 

20 way, differences in the values of more important attributes result in larger distances than do 
differences in less important attributes. 

Automated navigation according to the invention can be applied in many domains. 
For example, in analysis of manufacturing lines, measurement datasets exist for machines 
in the manufacturing line as well as for the interconnection of these machines. Automated 

25 navigation according to the invention can aid with decision support for scheduling and 

planning based on this data. By way of a further example, in transportation systems, datasets 
exist for measurements taken by road sensors and traffic reports. Automated navigation 
according to the invention can aid in planning highway capacity over the entire network of 
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roadways. It is to be understood that the above applications are merely exemplary in nature 
and not intended to limit the applicability of the invention. Furthermore, it is to be 
appreciated that automated navigation according to the invention can be accomplished 
centrally at a server or in a distributed manner amongst several smaller server machines. 
5 These and other obj ects, features and advantages of the present invention will become 

apparent from the following detailed description of illustrative embodiments thereof, which 
is to be read in connection with the accompanying drawings. 

Brief Description of the Drawings 

10 FIG. 1A is a block diagram illustrating a system for implementing an automated 

navigation system according to an exemplary embodiment of the invention; 

FIG. IB is a block diagram illustrating a hardware implementation for both an end- 
user computer system and an analysis server computer system according to the invention; 
FIG. 2 is a flow diagram illustrating an automated navigation method according to 
15 an exemplary embodiment of the invention; 

FIG. 3 is a flow diagram illustrating a technique for computing a target collection 
descriptor that best matches a source collection descriptor according to an exemplary 
embodiment of the invention; 

FIG. 4 is a flow diagram illustrating a technique for computing a distance metric 
20 according to an exemplary embodiment of the invention; and 

FIG. 5 is a diagram illustrating a graphical user interface for presenting exemplary 
results associated with automatic navigation according to an exemplary embodiment of the 
invention. 

Detailed Description of Preferred Embodiments 

25 It is to be appreciated that the term "processor" as used herein is intended to include 

any processing device, such as, for example, one that includes a CPU (central processing 
unit). The term "memory" as used herein is intended to include memory associated with a 
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processor or CPU, such as, for example, RAM, ROM, a fixed memory device (e.g., hard 
drive), a removable memory device (e.g., diskette), etc. In addition, the term "input/output 
devices" or "I/O devices" as used herein is intended to include, for example, one or more 
input devices, e.g., keyboard, for inputting data to the processing unit, and/or one or more 
5 output devices, e.g., CRT display and/or printer, for providing results associated with the 

processing unit. It is also to be understood that various elements associated with a processor 
may be shared by other processors. Accordingly, software components including 
instructions or code for performing the methodologies of the invention, as described herein, 
may be stored in one or more of the associated memory devices (e.g., ROM, fixed or 

10 removable memory) and, when ready to be utilized, loaded in part or in whole (e.g., into 

RAM) and executed by a CPU. 

Referring to FIG. 1A, a block diagram is shown of a system for implementing an 
automated navigation system according to an exemplary embodiment of the invention. As 
shown, an end-user computer system 1 02 is coupled to one or more analysis server computer 

15 systems 104-1 through 104-K. Each analysis server includes one or more analysis 

applications 110-1 through 1 10-N with which the end-user computer system interfaces. The 
analysis applications are analysis programs relating to various applications for which 
analysis of datasets is required, e.g., manufacturing lines, transportation systems, etc. The 
analysis applications use a service interface component 120 to access datasets associated 

20 with a dataset access service component 130. The analysis applications also use the service 
interface component 120 to access the services of an inter-dataset navigation engine (IDNE) 
140. It is to be appreciated that the services interface component 120 is employed as an 
interface between the analysis applications and the dataset access service component 130 and 
the IDNE 140 since the various analysis applications may have different communication 

25 formats. In this manner, the dataset access service component and the IDNE do not have to 

handle a large variety of communication formats when communicating with the analysis 
applications, but rather, they communicate with the services interface 120 which preferably 
converts the various formats to a single format understood by the dataset access service and 
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IDNE. The services interface component 120 may also serve as a buffer for the dataset 
access service and the IDNE. The particular implementation of the services interface 
component is not critical to the invention since, given the design choices for the 
communication formats of the analysis applications, the dataset access engine and the IDNE, 
5 implementation of the interface is a matter of programming choice within the skill level of 

the ordinary artisan. 

The IDNE 140, as will be explained in detail below, provides automation for 
selecting target element collections that are close to a source element collection. To 
accomplish this, the IDNE has access to an externally specified description of attribute 

10 weights 145 that provides a means to associate a positive value with each attribute of every 
dataset accessed through a dataset access engine 150. The IDNE makes use of the dataset 
access service 130. Within the dataset access service 130 is the dataset access engine 150 
and one or more datasets 160-1 through 160-M. It is to be appreciated that the dataset access 
engine 150 may be implemented in many ways. For data that is organized as relational 

15 tables, engine 150 is implemented as a relational database engine. For data that is organized 

as a multidimensional database, engine 150 is implemented as a MDDB engine. Further, the 
dataset access engine 150 may be a combination of several conventionally available data 
access engines. The engine and its datasets may be local to a single computer or may be 
distributed across a plurality of computers, e.g., using a client-server protocol. 

20 Referring now to FIG. IB, a block diagram is shown of a hardware implementation 

for both an end-user computer system 102 and an analysis server computer system (e.g., 104- 
1 through 104-K) for implementing the invention. Each computer system includes a 
processor 170 coupled to a memory 180 and I/O device(s) 190. In the case of an analysis 
server, the processor 170 performs the functions associated with the various components 

25 running therein. The memory 180 is used by the processor for performing such functions 

and for storing the datasets and results of the processes. The I/O devices may include one 
or more data input devices (e.g., keyboard, etc.) for inputting data, if needed, and/or one or 
more data output devices (e.g., display) for presenting a user with results associated with the 
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functions performed in accordance with the various components. For example, a display 
may present a user with a graphical user interface for viewing such results. As indicated, 
both the end-user computer system and analysis computer system may have such a hardware 
architecture. Also, it is to be appreciated that each analysis server may be in communication 
5 with the end-user and each other analysis server via conventional communication links, e.g., 
local area network, wide area network, etc. Further, as mentioned, more than one computer 
system may be employed to implement the components illustrated in any one analysis server. 

Referring to FIG. 2, a flow diagram is shown of an automated navigation method 
according to an exemplary embodiment of the invention. It assumed that a user (e.g., 

10 analyst) at the end-user computer system 102 calls upon at least one of the analysis 
application programs (110-1 through 110-N) running on at least one of the analysis servers 
(104-1 through 104-K) to assist in a particular analysis task, e.g., the long response time 
example detailed above. In such case, the analysis application communicates with the IDNE 
140 and dataset access services 130 such that these components can provide the user with 

15 automated navigation between datasets containing dynamic data and having dissimilar 

structures in order to complete the particular analysis task. 

Accordingly, in step 200, the IDNE is provided with a source collection descriptor 
(SCD) from an analysis application. The source collection descriptor may have been 
identified by the user at the end-user system or generated by the analysis application. 

20 Similarly, in step 210, the IDNE is provided with a list of target datasets (LTDS) from an 

analysis application. Again, these may also be specified by the user or the analysis 
application. The IDNE then obtains the listed target datasets from the dataset access engine 
150. It is to be understood that the dataset access engine 150 retrieves these datasets from 
the appropriate memory locations where such datasets are stored. Then, in step 220, the 

25 IDNE considers each target dataset within this list in turn. TDS denotes a target dataset in 

the LTDS. In step 230, a collection descriptor in TDS is obtained such that the collection 
descriptor is closest to (best matches) the SCD input to the IDNE in step 200. In step 240, 
the IDNE computes the distance (DIST) between the source and target element collections. 
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Then, in step 250, the name of the target dataset, the target collection descriptor, and the 
computed distance are saved in an OUTPUTLIST. 

The method then returns to step 220 where it is determined whether all the target 
datasets have been processed. If they have not, then steps 230, 240 and 250 are repeated for 
5 each TDS in turn. If all TDSs have been processed, the IDNE proceeds to step 260. In step 

260, OUTPUTLIST which contains the triplet set of information for each TDS processed is 
sorted by DIST. That is, each target collection descriptor generated may be ranked in a list 
with the target collection descriptor resulting in the smallest distance metric with respect to 
the source collection descriptor appearing at the top of the list and target collection 

10 descriptors resulting in increasingly larger distance metrics with respect to the source 

collection descriptor appearing correspondingly lower in the list. The OUTPUTLIST is then 
returned by the IDNE to the analysis application, which then provides the list to the end-user 
102 for display to the user. 

Referring now to FIG. 3, an exemplary technique is shown for computing a target 

15 collection descriptor that best matches a source collection descriptor, e.g., step 230 of FIG. 

2. In step 310, a preliminary target collection descriptor (pTCD) is constructed for the 
current target dataset being considered by appropriately transforming the source collection 
descriptor. For datasets organized as relational tables, this can be accomplished in the 
manner specified by the following pseudo-code: 

20 pTCD = Default collection descriptor for TDS 

Do for each constraint in SCD (which is the SQL where clause used in the SCD) 
If the attribute of the constraint is in the schema of TDS 
add the constraint to pTCD 

End 

25 For datasets organized as multidimensional databases, step 310 may be accomplished in the 

manner specified by the following pseudo-code: 
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Do for each dimension sd in the source dataset 

td = dimension in TDS that's closest to sd (e.g., most attributes in common) 
scv = vector of SCD constraints for dimension sd 
tcv = vector of constraints in scv for which the attributes are in TDS 
Set dimension td of pTCD to tcv 

End 

In step 320, the final target collection descriptor is computed. For relationally 
organized data, this can be accomplished in the manner specified by the following pseudo- 
code: 

TCD=pTCD 

Do until the element collection specified by TCD is empty 
For each constraint in TCD 

TCD' = TCD - {constraint} 
If the element collection of TCD 'is not empty 
TCD = TCD' 
Leave the do-loop 

Endif 

End 

Choose a constraint in TCD and delete it 

End 

This code removes constraints from the preliminary collection descriptor until a non-empty 
element collection is obtained. To perform step 320 for data organized into a 
multidimensional database, the following pseudo-code may be employed: 
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TCD=pTCD 

Do until the element collection specified by TCD is not empty 
For each dimension td in TCD 
TCD' = drill-up of TCD 
5 If the element collection of TCD 'is not empty 

TCD = TCD' 
Leave the do-loop 

Endif 

End 

10 TCD = drill-up on all dimensions of TCD 

End 



Here, constraints are removed in a manner that preserves the multidimensional structure of 
the data by performing drill-ups on dimensions until a non-null element collection is 
obtained. 

15 Referring now to FIG. 4, an exemplary technique is shown for computing a distance 

metric between a source element collection and a target element collection, e.g., step 240 of 
FIG. 2. In step 410, the set of constraints in the source collection descriptor (Count_S) is 
determined, and the weights of associated attributes (as specified in 145 of FIG. 1A) are 
added. Similarly, in step 420, the set of constraints in the target collection descriptor 

20 (Count_D) is determined, and the weights of associated attributes (as specified in 145 of FIG. 

1 A) are added. Then, in step 430, the difference between the two numbers is computed as 
the distance metric DIST. Also, it is to be appreciated that the distance metric may 
alternatively represent a difference in the respective number of constraints in the source 
collection descriptor and the target collection descriptor. 

25 Thus, as mentioned above, constraints may be assigned weights such that a particular 

constraint is considered more important than another constraint. For instance, if it is 
determined that constraint A is more important than constraint B, then constraint A is 
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assigned a larger weighting value than constraint B. Then, during respective computations 
of distance metrics between a source collection descriptor containing constraints A and B and 
a first target collection descriptor differing only by the absence of constraint A and a second 
target collection descriptor differing only by the absence of constraint B, the distance metric 
5 for the first target collection descriptor will be larger than the distance metric for the second 

target collection descriptor. This is due to the heavier weighting, that is, greater importance, 
of constraint A. Therefore, a target collection descriptor that contains constraint A but not 
constraint B is considered a better match with the source collection descriptor containing 
constraints A and B than a target collection descriptor that contains constraint B but not 

10 constraint A. 

Referring to FIG. 5, an example is shown of a graphical user interface 500 that 
displays the results produced by the invention. It is to be appreciated that this is preferably 
presented to the user (e.g., analyst) on a display associated with the end-user system 102. 
The information presented includes the dataset name (e.g., MVS Monitor 3, UNIX 

15 Accounting, Financials, etc.), the target collection descriptor formed for each target dataset 

considered, and the value of the distance metric computed for each target collection 
descriptor. Note that the list is sorted in descending order by value of the distance metric. 
Doing so helps the user to select the target collection descriptor and dataset that are most 
appropriate for the analysis at hand. 

20 Although illustrative embodiments of the present invention have been described 

herein with reference to the accompanying drawings, it is to be understood that the invention 
is not limited to those precise embodiments, and that various other changes and 
modifications may be affected therein by one skilled in the art without departing from the 
scope or spirit of the invention. 
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Cla i m s 

What is claimed is: 

1 LA method of automating navigation between data with dissimilar structures 

2 including a source dataset containing one or more data elements and at least one target 

3 dataset containing one or more data elements, the method comprising the steps of: 

4 determining at least one collection of data elements from the at least one target 

5 dataset that best matches a collection of data elements from the source dataset; and 

6 computing at least one distance metric between the at least one target collection and 

7 the source collection such that a user can select the at least one target collection given the at 

8 least one computed distance metric. 

1 2 . The method of Claim 1 , wherein there is a plurality of target datasets from which 

2 respective best matching target collections are determined and respective distance metrics 

3 are computed such that the computed distance metrics are presented to the user in a ranked 

4 order. 



1 3. The method of Claim 2, wherein the presenting step further includes presenting 

2 the respective target collection to the user along with the respective computed distance 

3 metric. 



1 4. The method of Claim 3, wherein the presenting step further includes presenting 

2 a respective name associated with the target dataset to the user along with the respective 

3 target collection and the computed distance metric. 

1 5 . The method of Claim 1 , wherein the source collection of data elements is specified 

2 by a source collection descriptor and the at least one target collection of data elements is 

3 specified by a target collection descriptor. 
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1 6. The method of Claim 5, wherein the data is organized in a relational database and 

2 further wherein the determining step includes deleting at least one attribute associated with 

3 the target collection descriptor that is not present in the source collection descriptor. 

1 7. The method of Claim 5, wherein the data is organized in a multidimensional 

2 database and further wherein the determining step includes performing at least one drill-up 

3 operation on the target collection descriptor. 

1 8. The method of Claim 1, wherein the determining step further includes the steps 

2 of: 

3 generating at least one preliminary target collection descriptor associated with the at 

4 least one target collection by transforming a source collection descriptor associated with the 

5 source collection; and 

6 removing constraints associated with the at least one preliminary target collection 

7 descriptor until a non-null element collection is obtained. 

1 9. The method of Claim 1 , wherein the source collection of data elements is specified 

2 by a source collection descriptor and the at least one target collection of data elements is 

3 specified by a target collection descriptor and further wherein the computing step includes 

4 calculating the difference between constraints in the source collection descriptor and the 

5 target collection descriptor to compute the distance metric. 

1 10. The method of Claim 9, wherein attributes of the constraints are weighted in 

2 accordance with their importance. 

1 11. The method of Claim 10, wherein the distance metric is proportionally larger 

2 when the source and target collection descriptors differ by an attribute of a constraint that has 

3 a heavier weight associated therewith. 
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1 12. Apparatus for automating navigation between data with dissimilar structures 

2 including a source dataset containing one or more data elements and at least one target 

3 dataset containing one or more data elements, the apparatus comprising: 

4 at least one processor operable to determine at least one collection of data elements 

5 from the at least one target dataset that best matches a collection of data elements from the 

6 source dataset, and to compute at least one distance metric between the at least one target 

7 collection and the source collection such that a user can select the at least one target 

8 collection given the at least one computed distance metric; and 

9 a memory coupled to the at least one processor for storing the at least one target 
10 dataset. 

1 13. The apparatus of Claim 12, wherein there is a plurality of target datasets from 

2 which respective best matching target collections are determined and respective distance 

3 metrics are computed such that the computed distance metrics are presented to the user in 

4 a ranked order. 

1 14. The apparatus of Claim 13, wherein the at least one processor is further operable 

2 to present the respective target collection to the user along with the respective computed 

3 distance metric. 

1 15. The apparatus of Claim 1 4, wherein the at least one processor is further operable 

2 to present a respective name associated with the target dataset to the user along with the 

3 respective target collection and the computed distance metric. 

1 16. The apparatus of Claim 12, wherein the source collection of data elements is 

2 specified by a source collection descriptor and the at least one target collection of data 

3 elements is specified by a target collection descriptor. 
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1 1 7. The apparatus of Claim 1 6, wherein the data is organized in a relational database 

2 and further wherein the at least one processor is operable to perform the determining 

3 operation by deleting at least one attribute associated with the target collection descriptor that 

4 is not present in the source collection descriptor. 

1 18. The apparatus of Claim 1 6, wherein the data is organized in a multidimensional 

2 database and further wherein the at least one processor is operable to perform the 

3 determining operation by performing at least one drill-up operation on the target collection 

4 descriptor. 

1 19. The apparatus of Claim 12, wherein the at least one processor is further operable 

2 to perform the determining operation by generating at least one preliminary target collection 

3 descriptor associated with the at least one target collection by transforming a source 

4 collection descriptor associated with the source collection, and removing constraints 

5 associated with the at least one preliminary target collection descriptor until a non-null 

6 element collection is obtained. 

1 20. The apparatus of Claim 12, wherein the source collection of data elements is 

2 specified by a source collection descriptor and the at least one target collection of data 

3 elements is specified by a target collection descriptor and further wherein the at least one 

4 processor is operable to perform the computing operation by calculating the difference 

5 between constraints in the source collection descriptor and the target collection descriptor 

6 to compute the distance metric. 

1 21. The apparatus of Claim 20, wherein attributes of the constraints are weighted in 

2 accordance with their importance. 
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1 22. The apparatus of Claim 21, wherein the distance metric is proportionally larger 

2 when the source and target collection descriptors differ by an attribute of a constraint that has 

3 a heavier weight associated therewith. 

1 23 . An article of manufacture for automating navigation between data with dissimilar 

2 structures including a source dataset containing one or more data elements and at least one 

3 target dataset containing one or more data elements, comprising a machine readable medium 

4 containing one or more programs which when executed implement the steps of: 

5 determining at least one collection of data elements from the at least one target 

6 dataset that best matches a collection of data elements from the source dataset; and 

7 computing at least one distance metric between the at least one target collection and 

8 the source collection such that a user can select the at least one target collection given the at 

9 least one computed distance metric. 
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SYSTEMS AND METHODS FOR AUTOMATED NAVIG ATION RFTWFFN 
DYNAMIC DATA WITH DISSIMILAR STRUCTURES 



Ahstract of the Disclosure 

Systems and methods are provided for automating navigation between dynamic data 
that has dissimilar structures, such as navigating between relational tables that have only a 
subset of their columns in common. That is, given a source dataset and source element 
collection, we want to navigate to an element collection in one or more target datasets. The 
automated navigation system includes an inter-dataset navigation engine that determines the 
best matching element collection within a plurality of target datasets. One method employed 
includes finding a descriptor of the target element collection in a target dataset. Then, a 
distance metric is computed between each source and target element. Lastly, a list that 
contains an entry for each target dataset along with its associated target element collection 
and distance value is output for use in a particular analysis task. 

1500-12 APP 
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AS A BELOW NAMED INVENTOR, I hereby declare that: 

My residence, post office address and citizenship are as stated next to my name. 

I believe that I am the original, first and sole {if only one name is listed below), or an original, first and joint inventor {if plural 
names are listed below), of the subject matter which is claimed and for which a patent is sought on the invention entitled: 
TITLE: SYSTEMS AND METHODS FOR AUTOMATED NAVIGATION BETWEEN DYNAMIC DATA WITH 
DISSIMILAR STRUCTURES 

the specification of which is attached hereto or indicates an attorney docket no. YQ998-467 , or: 

□ was filed in the U.S. Patent & Trademark Office on and assigned Serial No. , 

□ and (if applicable) was amended on . 

I hereby state that I have reviewed and understand the contents of the above-identified specification, including the claims, 
as amended by any amendment referred to above. I acknowledge the duty to disclose information which is material to patentability 
and to the examination of this application in accordance with Title 37, Code of Federal Regulations §1.56. I hereby claim foreign 
priority benefits under Title 35, U.S. Code §1 19(a)-(d) or §365(b) of any foreign application(s) for patent or inventor's certificate, 
or §365(a) of any PCT international application which designated at least one country other than the United States, or § 1 19(e) of any 
United States provisional application(s), listed below and have also identified below any foreign applications for patent or inventor's 
certificate having a filing date before that of the application on which priority is claimed: 
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{Application Number) {Country) {Day/Month/Year filed) 
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I hereby claim the benefit under Title 35, U.S. Code §120, of any United States application(s), or §365(c), of any PCT 
International application designating the United States, listed below and, insofar as the subject matter of each of the claims of this 
application is not disclosed in the prior United States or PCT International applications(s) in the manner provided by the first 
paragraph of Title 35 ? U.S. Code §1 12, 1 acknowledge the duty to disclose information material to patentability as defined in Title 
37, Cp9e of Federal Regulations §1.56 which became available between the filing date of the prior application and the national or 
PCT ^igbrnational filing date of this application: 



{Application Serial Number) {Filing Date) {STATUS: patented, pending, abandoned) 



{Application Serial Number) {Filing Date) {STATUS: patented, pending, abandoned) 

I hereby appoint the following attorneys: MANNY W. SCHECTER, Reg No. 31,722; TERRY J. ILARDI, Reg. No. 29,936; CHRISTOPHER A. 
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KEVIN M. JORDAN, Reg No. 40,277; STEPHEN C. KAUFMAN, Reg No. 29,551; JAY P. SBROLLINI, Reg No. 36,266; DAVID M. SHOFI, Reg. No. 
39,835; ROBERT M. TREPP, Reg. No. 25,933; LOUIS P. HERZBERG, Reg. No. 41,500; DANIEL P. MORRIS, Reg. No. 32,053; LOUIS J. PERCELLO, 
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